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DP-309576 (DEL01 P-464) 

IDENTIFICATION AND LABELING OF BEAM IMAGES 
OF A STRUCTURED BEAM MATRIX 

Technical Field 

[0001] The present invention is generally directed to identification and 

labeling of beam images and, more specifically, to identification and labeling 
of beam images of a structured beam matrix. 



Background of the Invention 

[0002] Some vision systems have implemented dual stereo cameras to 

perform optical triangulation ranging. However, such dual stereo camera 
systems tend to be slow for real time applications and expensive and have poor 
distance measurement accuracy, when an object to be ranged lacks surface 
texture. Other vision systems have implemented a single camera and 
temporally encoded probing beams for triangulation ranging. In those 
systems, the probing beams are sequentially directed to different parts of the 
object through beam scanning or control of light source arrays. However, 
such systems are generally not suitable for high volume production and/or are 
limited in spatial resolution. In general, as such systems measure distance one 
point at a time, fast two-dimensional (2D) ranging cannot be achieved unless 
an expensive high-speed camera system is used. 

[0003] A primary difficulty with using a single camera and 

simultaneously projected probing beams for triangulation is distinguishing 
each individual beam image from the rest of the beam images in the image 
plane. It is desirable to be able to distinguish each individual beam image as 
the target distance is measured through the correlation between the distance of 
the target upon which the beam is projected and the location of the returned 
beam image in the image plane. As such, when multiple beam images are 
simultaneously projected, one particular location on the image plane may be 
correlated with several beam images with different target distances. In order 



to measure the distance correctly, each beam image must be labeled without 
ambiguity. 

[0004] In occupant protection systems that utilize a single camera in 

conjunction with a near IR light projector, to obtain both the image and the 
range information of an occupant of a motor vehicle, it is highly desirable to 
be able to accurately distinguish each individual beam image. In a typical 
occupant protection system, the near IR light projector emits a structured dot- 
beam matrix in the camera's field of view for range measurement. Using 
spatial encoding and triangulation methods, the object ranges covered by the 
dot-beam matrix can be detected simultaneously by the system. However, for 
proper range measurement, the system must first establish the relationship 
between the target range probed by each beam and its image location through 
calibration. Since this relationship is generally unique for each of the beams, 
while multiple beams are present simultaneously in the image plane, it is 
desirable to accurately locate and label each of the beams in the matrix. 

[0005] Various approaches have been implemented or contemplated to 

accurately locate and label beams of a beam matrix. For example, manually 
labeling and locating the beams has been employed during calibration. 
However, manual locating and labeling beams is typically impractical in high 
volume production environments and is also error prone. 

[0006] Another beam locating and labeling approach is based on the 

assumption that valid beams in a beam matrix are always brighter than those 
beams outside the matrix and the entire beam matrix is present in the image. 
This assumption creates strong limitations on a beam matrix projector and the 
sensing range of the system. Due to the imperfection of most projectors, it 
has been observed that some image noises can be locally brighter than some 
true beams. Further, desired sensing ranges for many applications result in 
partial images of the beam matrix being available. 

[0007] What is needed is a technique that locates and labels beams of a 

beam matrix that is readily implemented in high-production environments. 
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Summary of the Invention 

[0008] The present invention is directed to a technique for identifying 

beam images of a beam matrix. Initially, a plurality of light beams of a beam 
matrix, which are arranged in rows and columns, are received after reflection 
from a surface of a target. Next, a reference light beam is located in the beam 
matrix. Then, a row pivot beam is located in the beam matrix based on the 
reference beam. Next, remaining reference row beams of a reference row that 
includes the row pivot beam and the reference beam are located. Then, a 
column pivot beam in the beam matrix is located based on the reference beam. 
Next, remaining reference column beams of a reference column, that includes 
the column pivot beam and the reference beam, are located. Finally, remaining 
ones of the light beams in the beam matrix are located. 

[0009] These and other features, advantages and objects of the present 

invention will be further understood and appreciated by those skilled in the art 
by reference to the following specification, claims and appended drawings. 

Brief Description of the Drawings 
[0010] The present invention will now be described, by way of 

example, with reference to the accompanying drawings, in which: 
[0011] Fig. 1 is a block diagram of an exemplary object surface 

sensing system; 

[0012] Figs. 2 A and 2B are diagrams showing vertical and horizontal 

triangulation relationships, respectively, for the system of Fig. 1 ; 
[0013] Figs. 3A-3C are diagrams of a 7 by 15 beam matrix images at 

close, middle and far target ranges, respectively; 
[0014] Fig. 4 is a diagram depicting the location of a reference beam in 

a beam matrix image; 
[0015] Fig. 5 is a diagram depicting the location of a row pivot beam 

in a beam matrix image; 
[0016] Fig. 6 is a diagram depicting the determination of the center of 

gravity of the row pivot beam in a realigned isolated search window; 



[0017] Fig. 7 is a flow diagram depicting a main program structure for 

locating and labeling beams in a beam matrix image; 
[0018] Fig. 8 is a flow diagram depicting a routine for locating and 

labeling beams in a row; 
[0019] Fig. 9 is a flow diagram depicting a routine for changing to a 

new row of the beam matrix image; 
[0020] Fig. 10 is a flow diagram depicting a routine for determining 

boundaries of a beam matrix image; and 
[0021] Fig. 1 1 is a flow diagram depicting a routine for re-labeling the 

beams of the beam matrix image. 



Description of the Preferred Embodiments 

[0022] According to the present invention, a technique is disclosed that 

applies a set of constraints and thresholds to locate a reference beam around 
the middle of a beam matrix. Adjacent to this reference beam, two more 
beams are located to establish the local structure of the matrix. Using this 
structure and local updates, the technique identifies valid beams to the matrix 
boundary. In particular, invariant spatial distribution of the matrix in the 
image plane and smoothness of energy distribution of valid beams are used to 
locate each beam and the boundaries of the matrix. The technique exhibits 
significant tolerance to system variation, image noise and irregularity matrix. 
The technique is also valid for distorted and partial matrix images. The 
robustness and speed of the technique provides for on-line calibration in 
volume production. As is disclosed herein, the technique has been effectively 
demonstrated with a 7 by 15 beam matrix and a single camera. 

[0023] With reference to Fig. 1, an optical surface configuration 

system 1 is depicted. The system 1 includes a laser or similar source of 
electromagnetic radiation 10 that directs an optical beam to an optical 
diffraction grating 12, which splits the beam into a plurality of beams, 
producing a rectangular grid pattern on a surface 15 of a target 14. The 
beams are reflected from the surface 15 of the target 14 and a camera 17 is 
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positioned to receive the reflected beams. A lens 16 of the camera 17 focuses 
the received beams onto an image surface 18, which provides an image plane 
20. A processor 19 having a memory subsystem 21 is provided to process the 
images formed in the image plane 20. 
[0024] With reference to Fig. 2A, the target 14 is shown having a 

surface 15 in an x-y plane at distance 'D' in the z direction from the lens 16, 
where the x direction is perpendicular to the page and the z and y directions 
are horizontal and vertical, respectively, on the page. The grating 12 is closer 
than the lens 16 to the surface 15 in the z direction by a distance 'd' and the 
image surface 18 is a distance T from lens 16 in the opposite z direction. A 
center 22 of the grating 12 is a distance Lo from the lens axis 24 in the y 
direction. A beam 26 is directed by grating 12 at an angle 0 from the 
horizontal z axis to strike the' surface 15 of the target 14 and is reflected back 
through the lens 16 of the camera 17 to strike the image plane 20 of the 
camera 17 a distance Y from the lens axis 24. Vertical triangulation is based 
on a mathematically derived relationship expressed in the following equation: 

Y = { f * [Lo + (D-d)tan9)]} / D 
For a given target distance, the preceding equation uniquely defines an image 
location Y in the image plane. Thus, the target distance may be derived from 
the image location in the following equation if d is chosen to be zero (the 
diffraction grating is placed in the same plane as the camera lens): 

Y = f * [L 0 / D + tan 9] 
When two dimensional probing beams are involved, horizontal triangulation is 
generally also employed. A horizontal triangulation arrangement is shown in 
Fig. 2B, with a being the diffracted beam angle and the image location in the 
image plane corresponding to X. The mathematical relationship is expressed 
in the following equation: 

X = f * (tan a (1 - d / D)) 
Since the beams have different horizontal diffraction angles a, the spatial 
separation between the beams on the image plane will be non-uniform as 'D' 
varies. However, if 'd' is made zero (the diffraction grating is placed in the 



same plane as the camera lens), the dependence will disappear. In the latter 
case, the distance X may be derived from the following equation: 

X = f * tan a 

[0025] It should be appreciated that an optical configuration may be 

chosen as described above with the optical grating 12 placed in the same plane 
as the lens 16 of the camera 17. In this manner, the horizontal triangulation, 
which may cause difficulties for spatial encoding, can be eliminated. In a 
system employing such a scheme, larger beam densities, larger fields of view 
and larger sensing ranges for simultaneous multiple beam ranging with a 
single camera and two dimensional (2D) probing beams can be achieved. 
Thus, it should be appreciated that the system 1 described above allows a two 
dimensional (2D) array of beams to be generated by the optical grating 12 to 
comprise a first predetermined number of rows of beams, each row containing 
a second number of individual beams. Each of the beams, when reflected 
from the surface 15 of the target 14, forms a beam image in the image surface 
18. The beam paths of all the beam images are straight generally parallel lines 
and readily allow for optical object-to-surface characterization using optical 
triangulation in a single camera. 

[0026] During system calibration, a flat target with a substantially 

uniform reflectivity is positioned at a distance from the camera system. For a 
vertical epipolar system (the alignment of the light projector with camera 
relative to the image frame), the matrix image shifts up and down as target 
distance varies. As examples, typical matrix images 300, 302 and 304 (at 
close, middle and far ranges) for the system of Fig. 1 are shown in Figs. 3A- 
3C, respectively. As is shown in Figs. 3A-3C, optical noise, distortion, non- 
uniform beam intensity and partial images of the matrix are typical. A goal of 
an algorithm that implements the present invention is to locate and label each 
of the beams accurately and consistently. 

[0027] The algorithm assumes that the beam matrix is approximately 

periodic and the number of beams in its row and column is known, i.e., 
N(row) by M(column) in rectangular shape. The algorithm also assumes that 



inter-beam spacing in the matrix is approximately invariant in the image plane. 
This condition can be satisfied as long as the beam matrix is projected from a 
point source onto a flat target. In this case, each beam is projected from this 
point to a different angle that is matched by camera optics. In this manner, 
the spatial separation between any two beams in the image plane becomes 
independent of target distance. 
[0028] The algorithm also assumes that the nominal inter-beam spacing 

(between rows and columns) and matrix orientation are known, i.e., center- to- 
center column distance = aQ (same row), center-to-center row distance = b 0 

(same column); orientation given by angle = 8 0 rotated clockwise from the 
horizontal direction in the image plane. Additionally, the algorithm assumes 
that at least three of the four boundaries of the matrix are present in the image. 
In the examples described hereafter, it is desirable for the left and right and at 
least one of the top or bottom boundaries of the beam matrix to be within the 
image frame. The matrix image is approximately centered in the horizontal 
direction of the image and moves up and down as the target distance varies 
(vertical epipolar system). Finally, as a reference, the image pixel coordinate 
is indicated with x (horizontal) and y (vertical), respectively, with the adjusted 
origin of the coordinate (0,0) being located at the top left corner of the image. 
[0029] An algorithm incorporating the present invention performs a 

number of steps, which seek to locate and label the beams of a beam matrix, 
which are further described below. 

1. Locate a reference beam in the beam matrix . 
[0030] A first beam found in the matrix is referred to herein as a 

reference beam. The starting point in searching for the reference beam is 
given by location (Xi,y it ) where Xj is the middle horizontal point of the image 
frame in the horizontal direction and a middle vertical point y x is defined by 
the possible vertical boundaries of the matrix (see Fig. 4). By using a pre- 
determined beam size threshold, the first beam that is larger than this 
threshold from the top at y lop and the first beam from the bottom at y bol are 
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located and yj is determined from the average of the difference (yboryu> P )/2. 
Such an arrangement ensures that the starting point is most likely in the 
middle area of the beam matrix with minimized searching overhead. 
[0031] Centered at (Xj,Xiyi), the reference beam is searched in a 2a 0 

cos9 0 *2b 0 cosBq rectangular-shaped window. This window size is selected to 
ensure that at least one true beam is included, while minimizing the search 
area. Since multiple beams may be included in the window, only one beam is 
selected that has the maximum one-dimensional energy (sum of consecutive 
non-zero pixel values in horizontal and/or vertical direction). In this 
implementation, the horizontal dimension (x) is used. For the selected beam, 
its center of gravity Cg(x) in horizontal direction is calculated. Passing 
through the center of gravity Cg(x), the vertical center of gravity Cg(y) of this 
beam is further calculated. 
[0032] It should be appreciated that it is still possible that the boundary 

of this selected beam may be limited by the boundary of the searching 
window. In order to accurately locate the reference beam, a smaller window 
centered at (Cg(x), Cg(y)) may be set to include and isolate the complete 
target beam. This window is an isolated searching window and is rectangular 
shaped with size a o cos9 0 *b 0 cos9 0 . Within this isolated searching window, the 
maximum energy beam is selected and its center of gravity (Cg^^g^)) is 

calculated and the beam is labelled as Beam (0,0). The initial beam labels 
may be relative to the reference beam. For example, a beam label Beam(n,m) 
indicates the beam at the n 1 * 1 row and m th column from the reference beam. 
The sign of the n and m indicates the beam at the right (m>0), left (m<0), 
top (n<0) or bottom (n>0) of the reference beam. The true label of the 
beams is updated at a later point using the upper left corner of the matrix. 

2. Find the row pivot beam from the reference beam . 
[0033] Next, the same-row beam on the right side of the reference 

beam, i.e., a row pivot beam with label Beam(0,l), is located. Invariant 



spatial constraint of the matrix in the image plane is applied and the nominal 
inter-beam column spacing and orientation is used initially (see Fig. 5). From 
the reference beam, the center of the isolated searching window is moved to 
the nominal center of Beam(O.l) at location (x 01 ,y 0l ): 
x 01 = Cg(x 00 ) + a 0 cos9 0 

yoi = C g(yoo) + a o sine o 
[0034] The a 0 cose o and a^inGo are referred to herein as row_step_x 

and row_step_y values, respectively. Within the window, one beam is 
selected according to its one-dimensional (x) maximum beam energy. Then 
the initial center of gravity of this selected beam is calculated. Due to the fact 
that the nominal beam spacing and matrix orientation have been used, it is 
possible that the isolated searching window may not include the complete 
target beam. To increase the system robustness and accuracy, the isolated 
searching window is re-aligned to the initial center of gravity location (see 
Fig. 6). The true center of gravity (Cg(x 01 ),Cg(y 01 )) associated with 
Beam(O.l) is then recalculated. With the locations of the reference beam and 
the row pivot beam, the local row_step_x and row_step_y values are updated 
as: 

rowjitepjc = Cg (x 0l ) -Cg (x 00 ) 
rowjtep jy = Cg (yj -Cg (yj 
The local matrix orientation is also updated as: 

Cg(x 0l )-Cg(x„) 

3. Locate the remaining beams in the row that includes 
the reference and the row pivot beams . 

[0035] Since the relative positions of nearby beams should be similar 

(smoothness constraint), the next beam location is predicted from its 

neighboring beam parameters. Using local row_step_x and row_step_y values 

from the previous step, the isolated searching window is moved to the next 
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test point to locate and calculate the center of gravity of the target beam. It 
should be noted that the final beam location (center of gravity) is typically 
different from the initial test point. In order to increase noise immunity, this 
difference is used to correct the local matrix structure for the next step. This 
process is repeated until no valid beam is found (using beam size threshold) or 
the frame boundary is reached. 
[0036] For example, to find Beam(0,n+ 1) (to the right of the reference 

beam) the isolated window is moved to the test point (xo(n+i)»yo(n+i)) from 
Beam(O.n) at (Cg(x 0n ), Cg(y 0n )): 

xo(n+i) = Cg(x 0n ) + row_step_x(n+ 1) 
yo(n+i ) = Cg(yon) + row_step_y (n + 1 ) 
row_step_x(n+ l) = row_stepjc(n) + [Cg(x 0n )- x 0 ( n )]/C 
row_stepjy(n + 1 ) = row_step_y{n) + [Cg (y 0n )- yoool/C 
where n= l,2,...,Cg(x 0n ) and Cg(y 0n ) is the center of gravity of Beam(0,n) in x 
and y directions, and C> = 1 is a correction factor. The choice of C 
determines the weighting of history (last step) and the presence (current center 
of gravity). When C = 1, for example, the next row steps will be completely 
updated with the current center of gravity. 
[0037] In a similar manner, the Beam(0, -n) to the left of the reference 

beam is found. The isolated window is then moved to the test point (x 0 (- n ), 
yo(-n)): 

xo(-n) = Cg(xoo-n)) + row_step_x(-n) 
yo(-n) = Cg(y 0 ( i -n)) + row_step_y (-n) 

row_step _x(-n) = row_step_x(-n + 1) +[Cg(xo(\. n ))-xo(\-n))VC 
row_step_y(-n) = row_step_y(-n+l) +[Cg(yo(\. fj) )-yo(\-n))VC 

4. Find the column pivot beam from the reference 
beam . 

[0038] Then, the next same-column beam on the topside of the 

reference beam, i.e., a column pivot beam with label Beam(-1,0), is located. 
The nominal row distance b 0 and the updated local matrix orientation are used 
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to move the isolated searching window to the predicted location (x ( .|)o,y(-i)o) 
for Beam(-1,0): 

x ( . 1 )o = Cg(xoo) + b o sin0 

y ( ., )O ==Cg(yoo) + boCOS0 
[0039] The values b o sin0 and b 0 cos9 are referred to herein as 

column_step_x and column_step_y, respectively. The calculation of the 
center of gravity (Cg(x ( .,)o),Cg(y ( -i)o)) is similar to that described for the row 
pivot beam. With the locations of the reference beam and the column pivot 
beam, the local column_step_x and column_step_y are updated as: 

column step _x= Cg(X(.] )0 )-Cg(xoo) 

column step _y = Cg(y ( .))o)-Cg(yoo) 

5. Locate the remaining beams in the column that 
include the reference and the column pivot beams . 

[0040] Starting from the reference beam or column pivot beams, the 

isolated searching window is moved down or up to the next neighboring beam 

using the updated columnstepx and column_step_y to the next neighboring 

beam. Similar to searching in rows, once the center of gravity of this new 

beam is located, the local column_step_x and column_step_y is updated for 

the next step. This process is repeated until no valid beam can be found or the 

image frame boundary is reached. 

6. Locate the rest beams in the matrix . 

[0041] At this point, one row and one column crossing through the 

reference beam in the matrix has been located and labeled. Locating and 
labeling the rest of the beams can be carried out row-by-row, column-by- 
column or by a combination of the two. Since the process relies on the 
updated local matrix structure, the sequence of locating the next beam is 
always outward from the labeled beams. For example, the next row above the 
reference beam can be labelled by moving the isolated searching window from 
known Beam(-1 ,0) to next Beam(-1 ,1). Its row_step_x and row_step_y values 
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should be the same as that of its local steps already updated by Beam(0,0) and 
Beam(0,l). Once the Beam(-l,l) is located, the new row_step_x and 
row_step_y values are updated using the relative location of Beam(-l,l) and 
Beam(-1,0). The process is repeated until all the valid beams in the row are 
located. Similarly, the beams in the next row are located until reaching the 
frame boundary or no beams are found. 

7. Determine the true matrix boundaries , 
[0042] The beams located to this point may include "false beams" that 

correspond to noise in the image. This is particularly true for a beam matrix 
that is created from a diffraction grating. In this case, higher order 
diffractions cause residual beams that are outside of the intended matrix but 
have similar periodic structures. In order to determine the true matrix 
boundaries, energy discrimination and matrix structure constraints may be 
employed. 

[0043] Since both of the column boundaries are present in the image, 

the total number of beams in one complete row must be equal to M for an N 
by M matrix. However, since the matrix can be rotated relative to the image 
frame, exceptions may occur when an incomplete row is terminated by the top 
or bottom boundary of the image. As such, those rows are not used in 
determining the column boundaries. Further, the rows that are not terminated 
by the frame boundaries but with beams less than M are discarded as noise. 
For any normally terminated row, if the total number of beams is larger than 
M, the additional beams are dropped one at a time from the most outside 
beams in the row using the fact that the noise energy should be significantly 
less than that of a true beam. The less energy beam between the beams at 
both ends of the row is dropped first. This process is repeated until M beams 
remain in the row. In order to eliminate possible singularities, a majority vote 
from each row is used to decide the final column boundaries. If there are 
rows that are inconsistent with the majority vote, their boundaries are adjusted 
to be compliant. 
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0044] The row boundaries of the matrix are determined in two 

different cases. If both boundaries are not terminated by image frame 
boundaries, the similar process described above for the column boundaries is 
used except that the known number of rows in the matrix is N. If one of the 
row boundaries is terminated by the frame boundary, the remaining number of 
rows in the image becomes uncertain. It is assumed that the energy variations 
between adjacent beams within the true matrix should be much smoother than 
that at the matrix boundaries. This energy similarity constraint among valid 
beams is applied in finding the row boundaries. Within the already defined 
column boundaries, the average beam energy for each row is calculated. 
Starting from the row that includes the reference beam outwards, the 
percentage change of energy between the adjacent rows is calculated. When 
the change is a decrease and larger than a predetermined threshold, the 
boundary is determined at the transition. 

[0045] If the remaining number of rows is less than N for the N by M 

matrix, the beams in the rows that are terminated by frame boundaries are 
retained and labelled, within the limit of N beams in the column. 

8. Label the final matrix with boundary conventions . 
[0046] For consistent labels with different frames, the relative labels 

with the reference beam are converted to a conventional matrix labels. The 
top left corner beam is labelled as Beam(l ,1), the top right corner beam as 
Beam(l,M), the left bottom beam as Beam(N,l) and the right bottom beam as 
Beam(N,M). The conversion is carried out with known matrix boundaries and 
the relative labels. 

[0047] While the algorithm has been implemented and demonstrated 

with a 7 by 15 beam matrix, it should be appreciated that the techniques 
described herein are applicable to beam matrices of different dimensions. 
Further, while the light projector has been described as consisting of a pulsed 
laser and a diffraction grating that splits the input laser beam into the matrix, 
other apparatus may be utilized within the scope of the invention. In any case, 
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a VGA resolution camera aligned vertically with the projector may capture the 
image of the matrix on a flat target. In such a system, it is desirable to 
synchronize the laser light with the camera so that the images with and without 
the projected light can be captured alternately. Using the differential image 
from the alternated frames, the beam matrix may then be extracted from the 
background. The differential images are then used to locate and label the 
beams as described above. Flow charts for implementing the above describe 
technique are set forth in Figs. 7-11, which are further described below. 

With reference to Fig. 7, a flow chart of a routine 800 that 
locates valid beams of a beam matrix is further depicted. In step 802, the 
routine 800 is initiated, at which point control transfers to step 804, where 
new image frames are captured using a differential approach and an initial 
search point (xj, yd is located. Next, in step 806, a reference beam is selected 
from an initial search window centered at the searching point and utilizing a 
window size 2aocos0o*2b o cos0o. Then, in step 808, an isolated searching 
window is set at the center of gravity of the reference beam and the center of 
gravity of the reference Beam(0,0) is updated. Next, in step 810, a row pivot 
beam is found using the nominal matrix structure and the matrix row structure 
is updated using a next row walking step. Then, in step 812, a column pivot 
beam is found from the reference beam and the matrix column structure is 
updated as a next column using next column walking steps. Next, in step 814, 
a walking algorithm is used to find all the beams in the matrix. Then, in step 
816, the invalid beams are dropped, as is disclosed herein. Then, in step 818, 
all valid beams are labelled and, finally, in step 820, the routine 800 
terminates. 

1 With reference to Fig. 8, a flow chart of a routine 900 is 

illustrated that discloses a technique for locating beams in a row. In step 902, 
the routine 900 is initiated, at which point control transfers to step 904, where 
the routine 900 walks from Beam(m,0) to the next right beam using an 
updated local row_step_x and row_step_y values. Next, in step 906, an 
isolated searching window, centered at the walking point, is opened and a 
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valid beam with the highest energy in the window is located. Then, in 
decision step 908, the routine 900 attempts to find a beam that is located at 
near the center of the window. If a beam is located and it is near the center of 
the window (j ud g ed with a pre-determined threshold), control transfers from 
step 908 to step 910, where the routine 900 updates the rowstepx and 
row_step_y values before walking to the next right beam and transferring 
control to step 906. Otherwise, if the beam is not near the center of the 
window in step 908, control transfers to step 912, where the routine 900 walks 
from Beam(m,0) to the next left beam using the updated local row_step_x and 
row_step_y values. Next, in step 914, an isolated searching window, centered 
at the walking point, is opened and a valid beam that has the largest energy in 
the window is located. Next, in decision step 916, it is determined whether a 
beam is found near the center of the window. If so, control passes to step 
918, where the routine 900 implements subroutine 1000 to change to a new 
row (see Fig. 9). If a beam is not found near the center of the window in step 
916, control passes to step 920, where row_step_x and row_step_y values are 
updated before walking to the next left beam, before control returns to step 
914. 

[0050] With reference to Fig. 9, a routine 1000 is illustrated. In step 

1002, the routine 1000 is initiated, at which point control transfers to step 
1004, where the routine 1000 walks from Beam(m,0) to Beam(m+ 1,0) using 
the column_step_x and column_step_y values. Next, in decision step 1006, it 
is determined whether a top boundary has been touched. If so, control 
transfers to step 1008, where the routine 1000 shifts right one column. 
Otherwise, control transfers to step 1010, where an isolated searching 
window, centered at the walking point, is opened in an attempt to find a valid 
beam that has the largest energy. Then, in decision step 1012, it is 
determined whether a valid beam is near the center of the window. If so, 
control transfers from step 1012 to step 1014, where the process of locating 
beams in a row is initiated. If a valid beam is not located near the center of 
the window in step 1012, control transfers to step 1016. In step 1016, the 
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routine 1000 walks from Beam(m,0) to Beam(m-1,0) using the column_step_x 
and column_step_y values. Next, in decision 1018, it is determined whether a 
bottom boundary has been reached. If so, control transfers to step 1022, 
where a one column shift to the left is implemented before transferring control 
to step 1020. In step 1018, when a bottom boundary has not been reached, 
control transfers to step 1020, where an isolated searching window, centered 
at the walking point, is opened in an attempt to find a valid beam that has the 
largest energy. Next, in decision step 1024, it is determined whether a valid 
beam is near the center of the search window. If so, control transfers from 
step 1024 to step 1014. Otherwise, control transfers from decision step 1024 
to step 1026, where the determined matrix boundaries process is initiated. 

With reference to Fig. 10, a routine 1 100 is depicted that 
determines the matrix boundaries. In step 1 102, the routine 1 100 is initiated, 
at which point control transfers to step 1 104, where a new row is selected. 
Next, in step 1 106, the number of beams in a row is counted. Then, in 
decision step 1108, it is determined if the number of beams is greater than or 
equal to 15. If so, control transfers to step 1 1 10, where the energies of the 
end-beams in the row are compared and the beams with the less energy are 
dropped until 15 beams remain, and then to decision step 1 112. In step 1 108, 
if the number of beams is less than or equal to 15, control transfers to step 
1 1 14, where the current row and all outside rows are dropped. Next, in 
decision step 1 1 16, it is determined whether the other direction has been 
tested. If not, control transfers from step 1 1 16 to step 1 104. Otherwise, 
control transfers from step 1 1 16 to step 1118, where the average energy of 
each row is calculated. In step 11 12, it is determined whether all rows have 
been tested and, if so, control transfers to step 1118. Otherwise, control 
transfers from step 1 1 12 to step 1 104. From step 1118, control transfers to 
step 1 120, where the beam energy drop between adjacent rows, from row 0 
outwards, is calculated. Then, in decision step 1122, it is determined whether 
the energy drop is greater than a threshold. If so, control transfers to step 
1 126, where the current row and all outside rows outwards of the current row 
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are dropped. If the energy drop is not greater than the threshold in decision 
step 1122, control transfers to decision step 1124, where it is determined 
whether all rows have been tested. If so, control transfers to decision step 
1 130. Otherwise, control transfers from step 1 124 to step 1 120. In step 
1130, it is determined whether both directions have been tested from the 
center of the matrix and, if so, control transfers to step 1 132, where the re- 
label process is initiated. Otherwise, control transfers from step 1130 to step 
1128, where the test direction is changed, and then to step 1 120. 

[0052] With reference to Fig. 1 1, a re-labeling routine 1200 is initiated 

in step 1202, at which point control transfers to step 1204, where the total 
number of rows that are currently labelled is determined. Next, in decision 
step 1206, it is determined whether the total number of rows is equal to 7. If 
so, control transfers to step 1208. Otherwise, control transfers to decision 
step 1210. In step 1208, re-labeling of the beams is initiated. In decision step 
1210, it is determined whether beams touch the top frame boundary of the 
matrix. If so, control transfers to. step 1212, where re-labeling of the beams is 
initiated. Otherwise, control transfers to step 1214, where re-labeling of the 
beams is initiated. From steps 1208, 1212 and 1214, control transfers to step 
1216, where the routine 1200 terminates. 

[0053] The above description is considered that of the preferred 

embodiments only. Modifications of the invention will occur to those skilled 
in the art and to those who make or use the invention. Therefore, it is 
understood that the embodiments shown in the drawings and described above 
are merely for illustrative purposes and not intended to limit the scope of the 
invention, which is defined by the following claims as interpreted according to 
the principles of patent law, including the doctrine of equivalents. 



